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<§) Video merchandising apparatus and method. 



© A muftimode video merchandiser system utilizes two levels of inductive learning to derive rules for selecting 
the sequence in which images of products stored on a videodisc are presented on a video monitor to a user. 
The first level of inductive learning generates rules from market survey based, consumer profile attributes 
assigned to herns selected by previous users to determine the profile of the consumer most fikely to be using 
the system at any given time, and to present the items in a sequence most likely to appeal to such a user. The 
second level of inductive learning utilizes a set of product characteristic attributes assigned to items selected by 
the current user to determine that user's preferences, and to modify the sequence of presentation to display first 
those items possessing the preferred characteristics. 
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VIDEO MERCHANDISING APPARATUS AND METHOD 



This Invention relates to err apparatus and a method for displaying Images of merchandise Hems to 
prospective customers in sequence and more particularly to such an apparatus and method which employ 
artificial Intelligence to customize the presentation to most effectively address the prospective customer's 
interests. 

ft it is becoming com m on today for merchandisers to utilize video systems to generate consumer interest 
in their products. The typical system displays images of a number of items in a fixed sequence. Some 
systems allow the user to select a particular group of items for review. For instance, the user may be 
offered the option of viewing any one of several styles of furniture. However, even in these systems the 
menu of selections available is fixed and the group of products selected is always presented in the same 

to sequence. One of these known fixed menu systems will provide specifications if more detail about an item 
is requested, and wiB check a main frame computer memory to determine If a product is available, but 
again the order of presentation of items is fixed. 

One system in use allows the user to indicate what features of a given product are most important and 
then selects items for presentation based on those features* For instance, If a user Is Interested in television 

rg sets and t ne ficates a particular interest in 13 inch color sets, with remote control and selling for less than a 
given price, the system will attempt to find Items meeting those specifications for display, if none are found, 
the least important features are successively dropped, without the knowledge of the user, until a match is 
found. Again, however, the sequence in which Items meeting the selected specifications are presented to 
the consumer te always the same. 

20 As the number of Items in the system and their diversity increase, it Is possible to discourage users 
who have particular Interests, by making them view the fixed sequence of items, many of which have Qttfe 
appeal to them, before items are presented which may be of interest It would be desirable therefore to be 
able to identify the type of person using the system In order to present first Items which will most likely 
appeal to that type of person. However, It has been found that If persons are asked directly for Information 

25 about themselves which would be helpful in determining what type of products would appeal to them, such 
as age, income bracket eta. the results are often not very reliable. 

It has been determined that certain types of persons tend to shop at certain times. However, the trends 
are not so well defined frat a rigid system can be reliably based upon them. 

It is therefore, the primary object of the present invention to provide apparatus and a method for 

30 displaying items to the users of video merchandising systems which adapts to the pattern in which different 
types of persons shop. 

Accordingly, with this object In view, the present invention resides in a method of controlBng a video 
system wfth a programmed digital computer to display to users in a controllable sequence images of a 
plurality of items, said method characterized by the steps oh generating an attribute file containing as to 

35 each Hem an assigned value for at least one selected attribute; establishing a (1st of said items sorted In the 
sequence to be presented by the video system based upon the assigned values of said at least one 
attribute; controlling said video system to display said hems In the order of said list; provkfing means for 
users to generate Inputs indicating interest in selected displayed Hems; generating a data file containing as 
to each user Input the Item selected and a recurring time period during which the input was generated; 

40 determining from the attribute file the assigned value of said at least one attribute for each of the selected 
items in the data file; determining from the recurring time periods of the inputs and the assigned values of 
said at least one attribute for the selected hems the most frequent value of said at least one attribute during 
each recurring time period; determining as to each hem during the time period said input was generated the 
match between the assigned value of said at least one attribute and the most frequent value of said at least 

45 one attribute during that time period; and resorting said list of hems in descending order of said match 
between the assigned value and the most frequent value during the time period said input was generated of 
said attribute, whereby the sequence rn which said items are displayed changes in accordance with the 
responses of users during the respective time periods. 

The invention also resides in an apparatus for sequentially displaying to a number of successive users 

so merchandise items to which a plurality of attribute values indicative of the appeal of the hern to selected 
classifications of users during a plurality of recurring time periods have been assigned, said system 
characterized by: a video recorder in which Images of said items are stored; a video monitor on which said 
stored images are selectively displayed; interface means by which users generate inputs identifying 
displayed items in which they are interested; and a digital computer programmed to record the items 
identified by the inputs and a recurring time period during which each input was generated, to apply an 
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inductive learning algorithm (IL1) to the attribute vaiues of the selected items to determine the most likely 
attribute values of items selected by users during each of said recurring time periods, and to select the 
sequence in which the images stored in the video recorder are displayed on said video monitor in 
descending order of a match between the attribute values assigned to each item and said most likely 
5 attribute values for the current recurring time period. 

The preferred embodiment of the invention will be described by way of example, with reference to the 
accompanying drawings in which: 

Rgure t is a schematic diagram of a video merchandising system incorporating the invention; 
Figures 2* 3, and 4 are decision trees illustrating the manner in which rules are generated in 
ro accordance with the teachings of the invention; 

Figures 5a and b when placed end to end with the connections Indicated by the encircled letters A 
and B, illustrate a flow chart of the software for the merchandiser system Incorporating the Invention; 

Figure 6 is an illustration of a video display generated by the merchandiser system incorporating the 
invention; 

75 Rgure 7 is a flowchart of the software for executing the first level of inductive learning in accordance 

with the invention; 

Figure 8 is a flowchart of the software for executing the second level of inductive learning in 
accordance with the teachings of the invention; 

Figure & Is a flowchart of the software for rearranging the list of items presented to the user as 

20 directed by the second level of Inductive learning; and 

Figures 10a and b illustrate a flowchart of the software for the rule making algorithm used by the first 
level of inductive learning which is described m the appendix to this application, 

Rgure 1 illustrates apparatus for carrying out the invention which includes a video monitor 1, a 
videodisc player 3, and a programmed digital computer 5. A suitable commercially available system ts the 

2& Sony VIEW SYSTEMfTM) which includes their LDP 2000 laser videodisc player and SMC 2000 processor. 
A suitable user interface device 7 such as a touch screen attachment for the video monitor 1 provides 
means for the user to generate Inputs to the system. 

Recorded images of the Items to be presented by the system, and video demonstrations of at least 
some of those Items, may be randomly accessed by the videodisc player for display on the monitor. 

30 Sequencing of the presentations Is controlled by the programmed digital computer 5 which Is interactive 
with the user through the video monitor touch screen 7. 

The system operates on the market principle that during certain hours of certain days a specific type of 
consumer will be shopping and that a video catalog presentation of the merchandise of interest can be 
customized to this type of customer. Through the use of an inductive teaming program in conjunction with 

35 user input to an interactive computer, the frequency of inspection of a product is recorded when the 
consumer specifically requests more information about an item vta an input device such as the touch 
screen 7. This data is then processed in an attempt to recognize viewer interest and to refine viewing 
patterns to present catalog hems in a sequence most appealing to an individual viewer. Data from users is 
categorized and processed by time, day and month increments such that the video presentation wilt be 

40 customized to any time increment determined by user input For example, although hourly increments may 
be used to categorize the inputs, through the inductive learning executions, dusters of similar hourly 
patterns may emerge such that three incGviduai hours with similar presentations will seem to "merge" to 
form a three hour cluster. Any time increment is possible, but the exemplary system will be sensitive to 
hourly, daily, and seasonal increments. 

45 The exemplary embodiment of the invention uses two separate inductive learning algorithms. The first 
algorithm which Is used for a first level of inductive learning by the system, incorporates an algorithm called 
ID3 described in an article by J. R. Quintan entitled 'Induction of Decision Trees" which appears In 
Machine Learning 1:81-106, Kluver Academic Publishers, Boston 1986. The second algorithm used at the 
second level of Inductive learning is a less sophisticated program described below. Each of these 

so algorithms requires a set of attribute values for each item of merchandise to be displayed. In the exemplary 
embodiment, the ID3 algorithm is used to evaluate a product gender value, a consumer income range for 
the product and the age range of a consumer interested In the product These values are the result of 
extensive market studies for each Hem of merchandise. The second less sophisticated algorithm evaluates 
attributes that identify the consumer's Interest; such as whether the Item is electronic, easy to clean, trendy, 

55 etc It is to be understood that other or additional attributes may be utilized for the two levels of inductive 
learning. 
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The first level of inductive teaming is used to determine the type of shopper who is most likely to be 
using the system & the present time based upon the customer attributes of the items selected by previous 
users during corresponding, time periods. The items are then arranged by how ctosely their consumer 
attribute profiles; materr the assumed shopper, 
s.: In; an effort to. guess who the current customer is. the ID3 algorithm, as described by J. R. Quinlan, Is 
applied to. the customer attributes. Items are then arranged by how closeiy their consumer attribute profiles 
match the assumed shopper* 

For the: inductive teaming process, several data files are used. There is a file which stores consumer 
profile data for each item and a separate file used to store items viewed by users. These two files are then 
70 used to create data files actually accessed by the inductive learning process, 

A very short example will clarify the steps Involved. Far the purpose of demonstration, all time 
parameters: have been simplified. Time of day has been classified as working (w) and non-wortdng (nw) 
hours, days of the week are weekdays {wd) or weekend (we) days, and months are summer (6) or non- 
summer (ns). These categorizations are arbitrary and have been selected for the purpose of demonstration 
is so that arr "interesting* rule can be derived using a minimum of data-records. 

When a customer indicates an interest in an item, the system stores in a file the time of day and the 
product which was viewed. After several user interactions, the data file could look Dke this: 



an 



30 



35 



TABLE 1 
User Response Data File 
Day af Week Month Hour Item 



we s 



w Osterizer Blender 



we 



s nw Coffee Grinder 



V e ns v Kitchen Center 

Applicance 

wd ns nw Electric Wok 

wd s w Self-Sharpening 

Scissors 

wd ns nw Toaster 

we ns nw Band Mixer 

Each item in the data base has a consumer attribute profile assigned through market research. The 
profile describes the type of person most often Interested in this type of product by describing in the 
exempfary system such a person's age, gender, and income range. As with the time Information, these 
attributes have been arbitrarily clustered for ease of demonstration as follows; 
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TABLE 2 

Consumer Attribute Categories 
Attribute Value Range 

Age < 25 

25-40 
> 40 



Value Assigned 
0 
1 
2 



15 Gender More Male Consumers 

Both Female and Male 
Consumers 

so More Female Consumers 



0 
1 



30 



Income < §20K 

$20K - $40K 
> $40K 

The item consumer profile for several products look (Ike this: 



0 
1 
2 



35 



45 



56 
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TABLE 3 

Itenr Consumer Attribute Profiles 

r 

Itear Age k Gender Income 

(Ssterxzeir Blenefer (1 2 0) (0 2 1) (1 0 2) 

w Hand Mixer (1 2 0) (2 1 0) (1 0 2) 

Ctoffee Grinder (1 2 0) (1 2 0) (1 0 2) 

Steam- Iron (2 10) (2 1 0) (0 1 2) 



75 



29 



25 



90 



69 



SeLf-Sharpening ' (2 0 1) (1 2 0) (O 1 2) 
Scissors . 

BtnTifflT Oiil h-tt (2 10) (2 1 0) (0 2 1) 
Appliance 

Electric Wok (10 2) (10 2) (1 2 0) 

Toaster (10 2) (12 0) (0 1 2) 

La Chef Eood (1 2 0) (12 0) (1 0 2) 
Processor 

Vista Food Processor (1 2 0) (2 10) (2 1 0) 



The parentheses enclose an ordered list of frie attributes of the consumers who most frequently 
purchase the product For example, the Oeterizer Blender most often Es purchased by a consumer in the 
25-40 year old range (designated by the 1 in the first place of the first set of parentheses), followed by the 
people over 40. and least by people under 25. This complete ordered listing is needed for scoring items 
against the assumed consumer as win be described later. 

Using the item consumer attribute profiles of Table 2 and user response data of Table 1, three data files 
are built for the inductive learning process. For each record in the user response data file, an entry is 
created for each of the age data file, gender data file, and income data file by recording the time 
^ information and the first value in the item's consumer profile attribute value list For example, the first user 
response record (we s w Osterizer Blender) would create the following three entries: 

Age Data File (AGE. DAT) 
45 we s w 1 

Gender Data File (GEN. DAT) 

we s v 0 

Income Data File (INCOME.DAT) 

we s' w 1 



55 



The final data fifes for the example are as follows: 
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TABLE 4 
Example Data File 

5 

AGS. DAT • • 



ve 


s 


w 


1 


we 


5 


nw 


1 


ve 


ns 


w 


2 


ve 


ns 


nv 


1 


wd 


s 


w 


2 


wd 


ns 


nv 


1 


we 


ns 


nw 


1 



GEN. DAT 



25 



we 


8 


w 


0 


we 


S 


nw 


1 


we 


ns 


w 


2 


wd 


ns 


nw 


1 


wd 


s 


w 


1 


wd 


ns 


nw 


1 


we 


ns 


nw 


2 



INCOME . DAT 



36 



40 



we 


6 


w 


1 


we 


S 


nw 


1 


we 


ns 


w 


0 


wd 


ns 


nw 


1 


wd 


s 


w 


0 


wd 


ns 


nw 


0 


we 


ns 


nw 


1 



45 

From these data files, the first level of the inductive process uses the ID3 algorithm, to derive a rule, In 
the form of a decision tree, that can be used to decide who is currently using the machine. Accorcfing to the 
1D3 algorithm, the value of the information which would be gained by using a specific attribute as a 
branching node in the decision tree can be determined by the following formula: 
so Qein(A) s ((overall) * E(A) 

(The gain that can be expected by using an attribute A as a branching node is equal to the information 

content of the attribute less the expected information requirement). 

where: 
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55 



70 



75 



50 



40 



50 



where A Is any attribute. 

p istfcie number of occurrences of value p for attribute A. 

n is the number of occurrences of value n for attribute A. 

and v is the total number of occurrences of attribute A. 

Looking only at the gender data file, the formula would be applied as follows: 

Rrst we isolate the "classes* of the data file - or the results of the data records. In our case, the results 
arethe consumer attribute values; 

#oocurrenc850fQ »T 
Occurrences of t * 4- 
^occurrences of 2 = 2 

Calculating the information content gives the following: 
l(GEN) = l to* i-f logi 4-2 log, 2 
* 1378 bits 

Now. Isolating only the day-of-weok attribute for the gender file, we get the following data table: 

TABLE 5 
Day-of-Week Attribute 
Summary for Gender File 
Day-of-Week Value Summary of Data 

we # records = 4 

# 0 values = 1 

# 1 values = 1 

# 2 values » 2 

wd # records » 3 

# 0 values = 0 

# 1 values = 3 

# 2 values = 0 
Using this data, the equation for we is: 



55 



the equation for wd is: 
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I = § I0G2 §-| log* § - § f0Q2 § « 0 

and the equation for the expected information requirement Is: 

E(day-of-week) « j «we) + § l(wd) 

- 357 bits 

5 

Therefore, to calculate the gain, we simply subtract the above E from the value of the overall 
information content calcutated previously; 

Gain(day-of-week) « 1.378- £57 = .521 bits 
Similarly, the inductive learner derives; 
to Gain(month) m .414 
Gain(hour) = 236 

The ID3 algorithm chooses the day-of-week attribute as the root node for the decision making free 
because it has the maximum information value. The data is then divided based upon the value of the day- 
of-week attribute value: 

1S 

TABLE 6 

Day-of-Week Decision Tree 
Root Node and Resulting Data Sets 

20 

* Pay of Week 







wd 






we 






25 


ns 


nw 


1 


s 


w 


0 






s 


w 


1 


s 


nw 


1 


* 




ns 


nw 


1 


ns 


w 


2 


• 


30 
























ns 


nw 


2 





Notice the day of the week attribute has been removed from the data file. 
as The same process described above is repeated for the month and hour attributes for each of the new 
data record sets. After the process is complete, the rule 10 illustrated in Figure 2 results. 

Similarly, rules 12 and 14 induced for the age and income data are shown in Figures 3 and 4. 
Notice on the Income decision tree 14 shown in Figure 4 that the final leaves of the decision trees may 
be ordered lists of values, rather than a single value. This occurs if "rule conflicts" arise from the data. In an 
^ ordered list, the first value is the one most often seen, the second Is the next most frequent value, etc. 

Once the rules have been established, they are used by the system to guess who is most probably 
using the system, and what kind of products that person prefers. To accomplish "best guessing*, the 
system checks internal clocks to determine the time parameters, then executes the rules. The Items In the 
database are then arranged according to how closely they match the rule results. For example. If a shopper 
^ enters the store at 10:00 AM on July 21 1 1886. the system executes the rules for a summer weekday during 
working hours and determines that someone with the following attribute profile is most likely to be currently 
using the system: 



so 



65 



TABLE 7 

Sample Consumer Profile for Summer Weekdays During Normal Working Hours 

Age-2 
Gender - 1 
Income -0 
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flu other wards* all the retired people on Social Security are shopping now.) To re-order an item In the 
database* the product's consumer profile is checked against the above determined consumer profile and 
the-, items are scared by how closely the profiles match. Items with the best scores (minimum in this case) 
are shown first To score the rtems^ a simple piece-checking algorithm ts used, tf the consumer's first profile 
5 values- exactly matsch the item's most common consumer profile,, a score of 0 results. However, if the 
profiles differ, t point is. collected for each place the attributes do not match. For example, the hand mixer 
has: the fallowing consumer profile taken from Table 3: 

Age Gen Income 

to: 

Hand Mixer (1 2 0) (2 1 0) (1 0 2) 

Checking this profile against the determined current consumer profile, we see the assumed consumer's 
age is one place away from the first spot so age gets a score 1. Similarly, gender and Income are both one 
75 place off and so they both get scores of 1 giving the hand mixer the composite score of 3. Similarly, all 
other items ui the data base are scored, then the items are sorted by score in ascending order. 

Utilizing: this sample consumer profile and place checking algorithm, an ordered list of the sample hems 
is gener ated which looks like this: 



TABLE 8 

Ordered List as Determined by 
Eirst Level of Inductive Learning 





Score 


Self- Sharpening Scissors 


0 


Kitchen Center Appliance 


1 


Steam Iron 


1 


Coffee Grinder 


2 


Toaster 


2 


Le Chef Food Processor 


2 


Hand Mixer 


3 


Self Sharpening Knivesr 


3 


Osterizer Blender 


4 


Electric Wok 


4 


Gourmet Cutlery Set 


4 


Vista Food Processor 


4 



Thfs Bst arranges the items in the order in which they are most likely to appeal to the assumed user of 
the system during the current time period selected for the example. As data accumulates, the profile of the 
assumed user could change based upon the selections made by previous users so that the list may be 
reordered based upon experience. The fist will be automatically reordered to reflect both short term and 
long term trends in the times thai different types of shoppers use the system. 
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The reordered list of items is used to determine the order in which items are presented to a user. The 
effects of reordering of the fist are best seen in a browse mode of the system to be discussed below in 
which all of tiie items are displayed sequentially in the order of the list The order,. however, also influences 
alb other item retrievals which are also discussed below. If for example,, the system is directed to access 
s drink makers, the order in which those products are shown will be consistent with their placement in the 
ordered Bst 

The reordering of the database is only carried out between users. Once a user initiates a session, the 
order of items in the data base remains fixed until the session is terminated. Termination of use by a given 
user is cntficated by an input by the user so Indicating, or by the elapse of a given interval following a 

ro request for an input by the system. If another user should begin using the system within the given interval 
so that the inputs appear to originate from the same user, there is no significant affect on the first level of 
inductive learning since it is the time the inputs were generated which is considered by the system and not 
whether they were generated by one or mora, users. It will, however, result In a delay in reordering of the 
data base by the first level of inductive learning, and will have a very definite affect on the second level of 

75 inductive learning. 

The second level of inductive learning attempts to Identify Hem characteristics which are interesting to a 
specific consumer. As with the first level of induction, data is collected for the personal inductive process 
when an Item demonstration Is requested. Instead of information about the Hem's consumer attributes, a 
second set of attributes which represents the user's preference in the functional characteristics of the item 
Is tracked. If the consumer is interested in items with the same characteristics, the second level of induction 
will converge on that pattern and arrange the sequence of items to be shown accordingly. Data is kept only 
for the user session, so each user creates his or her own set of important or preferred characteristics. 

In the item database, each item is related to a set of characteristics. A listing of this data using the 
items from the example above in order as determined by the first level of inductive learning, looks like this: 

TABLE 9 

Item Functional Characteristics 
Item Character! sties 

electronic 



20 



25 



30 



4$ 



50 



55 



Osterizer Blender 
Hand Mixer 

Coffee Grinder 
Steam Iron 

Self- Sharpening Scissors 
Gourmet Cutlery 

Self- Sharpening Knives 
Kitchen Center Appliance 

Electric Wok 
Toaster 

Le Chef Food Processor 
Vista Food Processor 



traditional, "easy to 
clean" , simple 

trendy, compact 

electronic, traditional 

traditional , simple 

traditional , simple , 
bulky 

trendy 

bulky , el ectronic , 
complex 

trendy, "easy to clean" 
traditional, simple 
trendy, compact, simple 
trendy, bulky, complex 
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Whsr a demunstraiiarr of one of these items is requested, a number of things happen. First, a list of 
previously viewed items is checked to make sure this item has not already been processed, as items are 
only processed, onca for each consumer, if the item is a new one, the name is added to the "previously 
seen*"* lis^ thee hem's: conanner attribute information is stored for the first level of induction, and then the 
s . item's characteristics, are processed. For each characteristic of an item, en entry ta kept in the database 
stating: toft characteristic and- the number of times that characteristic has occurred this user session. For 
©campie; f rffth© consumer views the Hand Mixer, the following entries would resufc 

TABLE 10 

"Important Characteristics 11 Table 
Following Demonstration of the Hand Mixer 

Characteristics # Occurrences 

traditional 1 

easy to clean 1 

*** simple 1 



When only one item has been demonstrated, no reordering of future presentations Is done, because a 
characteristic is not considered significant unless it appears more than once. Thus, the above entry would 
25 cause no change in order. If, however, the consumer then looks at the toaster, the entries in the 
characteristic table look like this; 

TABLE 11 

30 "Important Character! sties* Table 

Following Demonstration of the Toaster 

Characteristics * Occurrences 

35 traditional - 2 



'easy to clean 1 
simple 2 

Now a significant trend is developing. 

An example will show how the trend affects the later presentation of Items. Assume the entries In Table 
11 were logged by the computer in response to the consumer's selections. Also assume the ordered list of 
45 items in Table 8 makes up the complete ordered item database. If the consumer requests to see items 
which chop, cut or grind vegetables, the following list of items is collected from the ordered database in 
Table 6 and sent to a "user-presentation" routine: , 

BO List 1 * 
(terns Which Chop/Cut/Grind Vegetables 



55 
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("LsChef Food Processor"' ''Self-Sharpening Knives - "Osterteer Blender* "Gourmet Cutlery Set" "Vista 
Food Processor") 

To order these items, the user presentation routine first creates the list of "important characteristics" 
established by looking for those characteristics which appear most frequently in Table 11. In this example, 
th* list is: 



LtetZ 

Important Characteristics * 
(traditional, simple) 

rs The item List 1 Is then split Into three subGsts based on how many characteristics the items have in 
common with the list of "important" characteristics. First a sublist of items which have ALL the "important" 
characteristics is collected from List 1. In this case, only the Gourmet Cutlery Set is both traditional and 
simple. The remaining four Items are then checked to see if they have ANY characteristics in common with 
the "important* ones. This list of partial matches contains only the Le Chef Food Processor, with "simple" 

so as a characteristic. The remaning Items are retained in their original order relative to each other based on 
their order of appearance in Table 8. The three sublists are then appended to give the final reordered list; 

List 3 

25 Ordered List Based On Second Induction 

All Match ("Gourmet Cutlery Set") 



30 



+ Partial Match ("Le Chef Food Processor") 

+ No Match ("Self -Sharpening Knives") 

("Osteriser Blender") 

as ("Vista Food Processor") 

Final Ordered List ("Gourmet Cutlery Set" 

"Le Chef Food Processor" 



4Q 



50 



"Self -Sharpening Knives" 
"Osterizer Blender" 
"Vista Food Processor") 

The items are then presented to the user in this new order. The second level of Inductive learning 
serves to highlight specific "best guess" items by bringing them quickly to the user's view. The overall 
"flavor" of the item fist is however maintained. 

As the user session progresses and other items are viewed, the Table 11 entries wilt change and a new 
characteristic could emerge as most important The program is immediately sensitive to such changes, as 
the entire process is repeated each time a group of items is passed to the user presentation routine. The 
process is also rerun each time an item is demonstrated so that the remaining items will be ordered in the 
most up-to-date order possible. Between users, ail characteristics data stored for the previous user session 
Is removed and a new table is established for the next consumer. 
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The merchandise* system- irt which the invention is used has been designed in layers. At the core of the 
system is a databasesof • product attributes, with videodisc informaSbn, pricing, and other product specific 
Informations. Above, foe* database Is s reJetionsJ network which allows the functional logic to choose and 
order items: basetforr -desirable attribute values. Finally the user help feature extracts information from the 

5 viewer, passes cm 1he need^dEta^ta- the> rest of the system* and prepares the responses for the user. 

This merchandiser system- has several* modes; of operation which are best understood by reference to 
thefiowchartlaf* the- systenr software illustrated la Figures 5a and b. Steps in the program which require 
user input- are identified ; in- thee flowcharts* by an asterisk; As indicated tn block 15 of Figure 5a, when the 
system issidle, an "attract: segment", designed to catch the ey* of passers-by, Is executed. The attract $ 

to- segment consists of; a- continuous - loop presenting current top-seffing items, sales items, and ln-store 
specials on the video monitor. The in-store specials portion of the attract segment is a written page 
describing items on special which are not necessarily on the system. This allows the system to remain 
current, without changing, th* videodisc for every new product tt is during the attract segment that fte first 
level of inductive learning, the ILt program, is executed to generate a rule for the current desirable attribute 

75 values. 

When a user becomes, sufficiently interested in the system to touch the screen, as represented by the 
'block 17, he or she is. taken through a brief help segment designed to familiarize new users with the 
symbols that are used throughout the session. Then the user Is presented with a main shopping menu 
whichoffers theEfdJlawin^ options:- 
20 1) Help wfth usfnglha ^steriL. 

2) Browsing through theeataJog. 

3) Selecting a gift 

4) Finding a specific Item. 

5) Finding an item which performs a specific function. 
25 6) Seeing what is on sale. And one Of the following: 

7) 

A. Attract segment Item. 

B. Touch the bar indicating what you would like to do', 
so C. Viewing the shopping cart items. 

The user selects a segment of the program by touching the appropriate statement in the menu. The 
help segment 19 of the program provides information to the user on the other portions of the system. A 
general overview of the system and how to use the help feature is initially presented, along with a listing of 
the other system functions. The user then can choose which segments of the program to call up. 

35. The browse segment 21 presents an overview of ail the products on the system by sequentially 
presenting.on the video monitor 1, at a user adjustable rate, all of the items in the system. The items are 
sorted prior to showing then* to the user so the Hems believed to be of most interest are shown first Figure 
6 illustrates a typical display* 23 for the browse segment In addition to a color picture 25 stored on the 
videodisc of- the ftem, the display Includes symbols which enable the user to control the flow of the 

40 program. instance if the user would tike to see a demonstration of the item he touches the "demo" 
symbol 27. If he would like to return to the main menu he presses the "menu 11 symbol 2S. tt the user would 
Pke to save the item in his "shopping cart* he presses the "save 0 symbol 31 which generates the "in cart" 
symbol 33 incficating that the Hern has been saved. 

The user can further control the presentation by touching the "go back" symbol 35 to return to an item 

45 that has been previously shown, the "stop" symbol 37 to freeze the currently displayed Item for 20 
seconds, or the "restart 1 * symbol 39 to resume the sequencing. The items are displayed for a nominal 
Interval, for instance 5 seconds, however, the user can speed up the sequence by pressing the "faster" 
symbol 41, or slow the sequence down by pressing the "slower" symbol 43. The preferred rate established * 
by the user is stored and used as the default rate for subsequent presentations to the current user. 

so The gift segment 45 assists the user in selecting a gift It is based on a marketing theory which asserts « 
that people should be categorized by their life styles and values when choosing suitable gifts, rather than 
more typical things like income or age. Thus the gift suggestion segment 45 begins by showing 6 images 
ol people and asks the user to choose which picture best describes the gift recipient When a selection is 
made, a number of gift ideas, such as four, are presented which have been determined most appreciated 

s&-- by the group choseru If the user is not pleased with these suggestions, the system will ask more typical 
questions, for example, the hobbies and age of the recipient or a desired price range of the gift, and then 
additional suggestions will be made based upon these selections. 
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The specific items segment 47 provides the user with two means for calBpg up information on a specific 
item, The user can describe the product by typing in a product name or description which utilizes a "spell - 
subroutine 4G, or he can choose to see an index 51. If the user types in a product name or description, a 
parsing routine ts used to make a "best guess* 53 of what the user has requested. If the user requests a 

5 generic Hem. for instance blenders, al) items meeting that description, and items having similar functions, 
will be selected for presentation. 

The specific function segment 55 permits the user to request a showing of items which perform a 
particular function or combination of functions. This segment is .also known as "build-a-sentence", because 
when the user chooses this option, a list of verbs and nouns are presented. When the user touches a verb 

70 describing what should be accomplished, the vaBd nouns tor the chosen verb are highlighted. The user 
completes a sentence by touching the appropriate noun and all Items fitting the description are used. The 
relational network is used to make creative es well as predictable suggestions. 

The sales segment of the program 57 allows the viewer to browse an electronic sales flyer. Any items 
on the system which have been marked "on sale" by store personnel are presented, in an order determined 

re by the inductive learner. When ad the items on the videodisc have been shown, the user has an option of 
seeing "other in-store specials", These are short appealing descriptions of other products In the store 
which should be noticed, but which are not yet on the system. 

The last option, 7, presented to view on the main menu is dependent on the user's path through the 
system, end whether any hems have been "saved* until now. When the user is first shown the main menu. 

20 after touching the screen during the attract segment the final option given the user is to see the Item that 
was on the screen during the attract segment when the user touched the screen. For example, if the user 
saw the Gourmet Cutlery Set and decided to Initiate a user session by touching the screen, the final option 
would be: 

"or touch here to see the Gourmet Cutlery Set" 

25 This option is offered so that the user does not have to relocate the item which interested him in initiating a 
session. TTib user only has one chance to respond to this option, however, as one of the following options is 
presented in subsequent presentations of the main menu. 

If the user is not seeing the menu for the first time, the final option may in fact be just a statement 
directing user to "touch the bar indicating what you would like to do". This statement merely acts as an 

so Instruction, reminding the person to touch the screen to provide input 

The last possibi&ty for the final option on the main menu is to "see the items in your shopping cart" 
When the user chooses to view the Items In the shopping cart, the shopping cart segment 59 of the 
program is entered. In this segment a screen displaying all the items which have been saved is displayed. 
The user can then see a demonstration of the item, or choose items to be inducted In a comparison as 

35 indicated in block 51. All the items specified will be compared and described 63. The first comparison 
prepared is a pricing comparison. In addition to the usual pricing information, the pricing comparison tells if 
there are multiple models of an item, and whether an Hem is on sale. Following the price information, the 
functional comparison of the items is prepared For this comparison, items with similar functions are 
grouped together and a summary of the results is printed on the screen. Finally, the user can see a detailed 

40 description/comparison of the Items. Again, like Herns are grouped, but this time the features are 
highlighted, first as to how the products are similar and then as to how they differ, if the items chosen from 
the shopping cart are not comparable, individual descriptions are suppled. All comparisons are created 
during the user's session, not preprogrammed* so that any changes in product features or pricing 
information would be included in reports without any programming changes required. 

45 As mentioned previously, the merchandiser system has been designed in layers. The only layer which 
the user sees is the top-most user help feature or the "communicator*. The communicator performs many 
tasks, all designed to make the system more user-sensitive, responsive, effective, and generally more 
-Intelligent", ' 7 

The most visible task which the communicator performs Is the selection and offering of help to the user. 

so If the user takes longer than is "normal* to respond to a menu or choice, the communicator will select a 
helpful message based upon the user's place in the system and the path taken to reach that place, and 
print out the message in a "FYI", (For Your Information) window. The system will make three such 
suggestions, telling what the various options will do, or even suggesting an appropriate response. If no 
response is noted after the third message, the system assumes the user has left and "times-out", re- 

56 executing the first level of inductive learning, IL1, and beginning the attract segment 15. 
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In adc&tiCTTta offering; frdpful suggestions to the user, the communicator performs background functions 
which influence the user, but which are not obvious. These functions ere performed by the portion of the 
software, described by. the flowchart of Figure 5b- After the user branches to any of the five main user 
options (browse, gift specific time, specific function, or safe items) the communicator accesses the 

s relational network to choose appropriate Items, block. 37* and then rearranges those based upon the second 

level of inductive teaming;. LZ. to mate a "best guess* as to what wUl be most interesting to this consumer t 
69. Rearrangement, of the items at this point in- flte program is only carried out if the current user has made 
at least two selections. For Instance, ff the user has just entered the system and has requested the browse 
segment, there- Is no information available yet to determine this user's preferences, and hence this * 

70 rearranging subroutine is bypassed. 

Appropriate items for the mode selected by the user are dsplayed one at a time as indicated in block 
71 in the sequence determined by the first level of inductive learning, and the second level of inductive 
learning, if appropriate. A request by the user, block 73, for a demonstration of the item currently being 
displayed on the: video- monitor is used as an indication of the user's particular interest In a specific item. 

75 Thus, in response to a request for a demonstration, the second level of inductive learning IL2 program is 
run, block 75, while a video recording stored on the videodisc of a demonstration of the product is 
presented on the video monitor, as Indicated far block 77. The K-2 program, which is discussed more fully In 
connection wrtfr Figure £ records the fact tha± the demonstration has been requested on the Item, together 
wittr the date, time, and month of the entry. Upon completion of the IL2 program, the remaining items 

2Q selected for the specified' system mode are rearranged in block 8t based on this updating of the second 
level of inductive teaming, if qspropriate* 

Whether or not a. demonstration has been requested, the shopper has the option of saving the Kern In 
his or ho- electronic shopping cart, block 83. Items saved by touching the save symbol 31 are stored, block 
85, for further consideration. 

zs At any time, the user has the option, block 87, of pressing the menu symbol 29 If he or she has seen 
enough items in the present mode and desires to return to the main menu. In the absence of an indication 
that the user wants to return to the main menu, the program loops back, block 89, to present the next item 
in the selected fist of items. 

When ad of the selected Hems have been presented, 8 submenu is generated, block 81, presenting the 

so options available to the user. The options available depend upon the user's past activity. For example, a 
user completing the gift section will be offered the option to review the gift suggestions presented, or see 
different gfft suggestions. If the user has saved Hems in the shopping cart, the option wfll be given to review 
these items also. To enharifee the versatility of thte menu, the program is written to interpret the sentence 
which describes the option chosen by the user. This Is done using a parsing routine, what*, in the 

35 exemplary embodiment, Is a key word matching routine which analyzes the character strings and causes 
the program to branch to the appropriate routine. This allows the options to be reordered, reworded, or new 
options to be added without changing any codB. 

Figure 7 Illustrates the flowchart for the first level of inductive learning. 1L1 . When the system times out 
mcficating that the last user has terminated use of the system, the IDS routine for the selected attributes, 

40 Income, age, and gender in the exemplary embodiment is run, block 93, A detailed flowchart for the 1D3 
routine is illustrated in commonly owned U.S. patent application Serial No. 828,524 filed on February 8, 
1986 in the names of William J. Leech and Thomas N. Dean and entitled "An Automated Rule Based 
Process Control Method wHh Feedback and Apparatus Therefore". For convenience, this flowchart is 
repeated and discussed in the appendix of this application. Software implementing the ID3 algorithm is 

49 commercially available from the assignees of this Invention, Westinghouse Electric Corporation, under the 
trademark MasterMinder. Herman Edge of Palo Alto, California, also markets software implementing the ID3 
algorithm under the designation Expert Ease. * 

The rules derived by the ID3 routine for Income, age and gender are loaded In block 95. Each of the 
rules is executed in block 87 to determine a current consumer profile by applying the rule to the data stored 

so In Table 1 in the manner described previously. Each of the Hems is then scored in block 99 according to * 
how closely they match tfie profile and the Items are then sorted based on the score in block 101 and the 
sorted list Is stored in block 103. If a new user has not touched the screen, block 105, the attract segment 
items are presented in block 107. When a new user does enter the system, the Introductory page Is 
presented; block 109. to instruct the user on how to use the system. 

55 Figure 8 illustrates in more detail the flowchart of the IL2 routine illustrated by the block 75 En Figure 5b. 
First a check is made in block 111 to determine if the Hem has already been processed to prevent counting 
it twice. If the Hem has already been recorded for this user, the remainder of the IL2 routine is bypassed 
and the demonstration is played in block 77. New Hems for this user session are added to the Hem list in 
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block 113 and the consumer attribute information for the item is recorded for the first level of inductive 
teaming, IL1, in block 115. If the item being examined does not have any assigned functional characteristics 
as determined in block 117, the video demonstration is played. If the assigned functional characteristic Is 

. already listed In the table as determined in block 119, the number of occurrences of that characteristic Is 

6 incremented tn block 121. tf (t is a new characteristic, it is added to the table with the number of 
occurrences set equal to 1, as indicated In block 123. Since an hem may be assigned more than one 
characteristic, this procedure is repeated for each characteristic assigned to the Item under review* When all 
of the characteristics have been recorded, or if no functional characteristic has been assigned to the item, 
the tt2 run routine is completed and the video demonstration is played in block 77. 

ro Figure 9 illustrates a flowchart for rearranging items in accordance with the second level of inductive 
learning, IL2. First the list of hems to be presented is gathered in block 125* Next, a check is made in block 
127 to determine if there are any trend candidates, that Is, are there any entries in the occurrence of 
characteristic tables, tf not the Fist of items is presented as a final list in block 129 with the sequence 
unchanged, tf there are any entries in the characteristic fist, they are sorted by the number of occurrences 

rs in block 131. if none of the characteristics has occurred more than once as Indicated In block 133, no 
significant trend has been detected and the list is not rearranged, if any characteristic has occurred more 
than twice, a list is made in block 135 of the top candidates. That is, a fist of the characteristic or 
characteristics that have occurred the most number of times. Such characteristics are considered the 
important characteristic or characteristics- Next a Bat is made, block 137, of the hems, if any, which match 

20 all of the important characteristics. A fist Is then made in block 139 of all of the items which have a partial 
match with the important characteristics. That is those items which are assigned at least one of the 
important characteristics. Finally a list is made, block 141, rn which the item having a total match with the 
important characteristics followed by those items having a partial match are moved to the top of the list of 
selected items as ordered by the first level of Inductive learning, ILL Items for which there Is no match with 

25 the important characteristics remain in the sequence determined by ILL This rearranged flst is then 
presented as the final list In block 129. 

A number of the features discussed above make this system unique. First is the use of inductive 
learning techniques to teach the system Items of Interest by determining the most desirable attributes at 
any given time based upon the input of previous users. This allows the system to be truly sensitive to user 

30 Interest and to respond appropriately. One significant advantage of this is that even after a pattern has 
developed, e.g. a trend in shopping habits changes for some reason, the inductive learning program will 
detect this change and adjust the presentation accordingly. In addition, the system can tailor a presentation 
to the individual taste of the current user, again using an inductive teaming program which is based upon a 
set of assigned attributes. 

35 tn addition to being responsive, the system is highly versatile* The versatility is achieved by reducing 
the product data base to a series of attributes based on extensive market research. The products era 
retrieved solely by their attributes, permitting items to be added or deleted, or the whole data base to be 
changed, without significantly changing the computer code. This allows the system to be generic in that any 
type of items may be added to the catalog, and they will be retrieved or sequenced using only their 

40 attribute values. Versatility is further enhanced by the system by the extensive use of automatic screen 
generation techniques such that most screens shown to the user are generated based upon the current user 
situation, making wording changes, option changes and formating changes trivial to implement. 

48 APPENDIX 

A detailed flow chart of the ID3 program suitable for generating the decision trees which derive the 
rules for the first level of inductive learning used in the present invention is set forth and described in 
commonly owned United States Patent Application Serial No. 826,524- filed on February 6, 1986 In the 
so names of William J. Leech and Thomas N. Dean and entitled "An Automated Rule Based Process Control 
Method With Feedback And Apparatus Therefore". This flow chart which appears as Figures 8a and 6. and 
the description thereof which appears on pages 16-20 of that application, are repeated here as Figures 10a 
and b and the description below for the purpose of providing suitable means for implementing the ID3 rule 
making algorithm. 

55 Once the sample set is selected, new rules are induced as illustrated in Figure 10. First the samples 
are input 112 and stored in a data structure, such as an array, matrix or list which is suitable for storing 
samples having multiple attributes where the samples must be sorted and subdivided during processing. 
Next an attribute is chosen 114 for testing to determine whether it is an appropriate spirt node for the 
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decision tree.. The attribute to be tested can be chosen arbitrarily, such as choosing the first attribute in the 
sample. The attribute Is tested 116 to determine whether ft is numeric Assuming that the attribute is 
numeric, a determination. tt8 is mads concerning; whether the attribute has a value in each sample. If each 
attribute does not have a value, a suitable value far that sample fe generated 120 by, for example, averaging 

5 the attribute values or randomly picking art ejtri&aite value.. Another strategy for handling absent values is to 
create. pseudasamples to.- substitute for the aarapfe* with the missing attribute. The missing attribute value for 
th'e-.pseudosamplescarr be generated basecF err the distribution of the attribute values for other samples in 
the^sampie-set or an a distribution such as a belt curve. 

The records are sorted 122 In ascending sequence according to the attribute value for the attribute 

io. selected; and then the sample set is split 124 into two sets between the first and second samples producing 
a. split value and a spirt Index. Next, an information gain function for creating a decision tree is evaluated 
t28 to produce the information gain for the split previously selected. The Information gain wilt be used to 
determine whether fte tested attribute is appropriate as the split node for the current level in the decision 
tree. The calculations necessary to evaluate this preferred function wifl be discussed in detail later. The 

tff resulting information gain along with split values and split index are stored 128. If the last sample has not 
been reached 130, the Index is advanced 132 and the sample set is split between the next two samples and 
the decision tree g en eration function is again evaluated. Once the end of the samples Is reached, the split 
whicfr produces the maximum information gain, along with the split value and spilt index. Is saved 134. If 
the erof of the attributes has not been reached T36, then the next attribute is chosen and the process 

to continues* again. 

After a similar process is performed for each symbolic attribute, the numeric or the symbolic attribute 
having the highest information gain and the corresponding indices are chosen 158 by comparing the 
Information gain for each attribute. Next the maximum numeric and symbolic Information gain values are 
compared 160 with each other, the attribute with the maximum is chosen and a decision tree record entry is 

25 created. The data structure of the decision tree win be discussed in more detail hereinafter. 

After the maximum Is chosen, the samples are again sorted 1B2, based on the selected attribute, Into 
ascending sequence If numeric and according to symbolic name If symbofic. Then- the sample set is 
divided into subsets based on the attribute with the maximum information gain and the corresponding split 
value and spilt index. If all the samples in each subset have the same class values, then the decision tree 

so for the subset structure and the corresponding rule Is saved, ff each sample in a subset does not have the 
same class values, then the algorithm is then executed for the subset as if It were the set That Is, the 
subset is treated as a set and the process of choosing attributes, sorting into ascending sequence, splitting 
and producing the information gain is executed. 

If during the execution of the above-discussed rules induction algorithm an attribute is encountered 

ss which requires the solution of a subproblem to produce a subrute, the submie is produced m the same 
manner as previously described. In the preferred embodiment the subproblems which appear In the 
primary problem are rule induced prior to primary problem rule induction, so that when a subproblem 
indicator Is encountered, the rule for that subproblem can be made available Immediately. An alternative to 
performing subproblem induction before primary problem induction, is to temporarily halt rules production 

4T' based on- the primary sample set while a rule is produced for a subproblem sample set Either the preferred 
or alternate approach can be appSed whenever a particular class value requires the solution of a 
subproblem. 



45 Claims 

1. A method of controlling a video system (1, 3) with a programmed digital computer (5) to display to 
users in a controllable sequence images of a plurality of items, said method characterized by the steps of: 
generating an attribute file containing as to each item an assigned value for at least one selected 
so attribute; 

establishing a list of said Items sorted in the sequence to be presented by the video system (1, 5) 
based upon the assigned values of said at least one attribute; 

controlfing said video system (1 , 3) to display said items in the order of said fist; 
providing means (7) for users to generate inputs indicating interest in selected displayed items; 
65 . generating a data file containing as to each user input the item selected and a recurring time period 
during which the input was generated; 

determining from the attribute file the assigned value of said at least one attribute for each of the 
* selected items in the data fie; 
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determining from the recurring time periods of the inputs and the assigned values of said at least one 
attribute for the selected items the most frequent value of said at least one attribute during each recurring 
time period; 

determining as to- each Item during the time period said input was generated the match between the 
5 assigned value of said at least one attribute and the most frequent value of said at least one attribute during 
tttattime period; and 

resorting said list of items in descending order of said match between the assigned value and the most 
frequent value during the time period said input was generated of said attribute, whereby the sequence in 
which said items are d&ptayed changes in accordance with the responses of users during the respective 
to time periods. 

2. The method of Claim 1 further characterized in that the step of determining the most frequent value 
of said at least one attribute comprises generating a rule (10, 12, 14) from the recurring time periods in 
which the Inputs are generated and the values of said attributes assigned to the selected items, and which 
rule groups together recurring time periods in which the most frequent values of said at least one attribute 

rs are the same. 

3. The method of Claim 2 further characterized in that the step of generating said attribute file 
comprises generating such a file containing as to each item an ordered group of assigned values for said at 
least one attribute, wherein sakJ step of determining the most frequent value of said at least one attribute 
during each recurring time period utilizes the highest order value of said attribute for the selected Hems, 

20 and wherein said matching step takes into account the order in which the most frequent value is assigned 
to said attribute for each item. 

4. The method of Claim 3 further characterized in that each ordered value of each attribute for- each 
Hern is assigned a numerical score, wherein the matching step comprises determining as to each item the 
numerical score assigned to the most frequent value of the attribute during the current time period, and 

25 wherein the resorting step comprises arranging the items In cyder of the numerical score of the most 
frequent value of the attribute for the current recurring time period. 

5. An apparatus for sequentially displaying to a number of successive users merchandise items (25) to 
which a plurality of attribute values indicative of the appeal of the item to selected classifications of users 
during a plurality of recurring time periods have been assigned, said system characterized by: 

so a video recorder (3) in which images of said Herns are stored; 

a video monitor (i) on which said stored images are selectively displayed; 
interface means (7) by which users generate inputs identifying displayed Hems In which they are 
interested; and 

a digital computer (5) programmed to record the items identified by the Inputs and a recurring time 
35 period during which each Input was generated, to apply an inductive learning algorithm (IU) to the attribute 
values of the selected Items to determine the most likely attribute values of items selected by users during 
each of said recurring time periods, end to select the sequence in which the images stored in the video 
recorder (3) are displayed on said video monitor (1) In descending order of a match between the attribute 
values assigned to each item (25) and said most likely attribute values for the current necurring time period. 
40 fl. The system of Claim 5 further characterized in that said merchandise items (25) have assigned Item 
characteristics and said computer (5) is programmed to apply a first inductive learning algorithm (IU) to said 
attribute values of items identified by inputs by all users, to apply a second inductive learning algorithm 
(1L2) to said item characteristics assigned to items selected by the present user to determine the Item 
characteristics most appealing to the present user, to adjust said selected sequence In which the Herns are 
4$ displayed to the present user only, and to present first to the present user items assigned the Hem 
characteristics most appealing to the present user. 
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